Papers with long-term memory retention
TELLME: Test-Enhanced Learning for Language Model Enrichment (2026.findings-eacl)
Copied to clipboard
Minjun Kim, Inho Won, HyeonSeok Lim, MinKyu Kim, Junghun Yuk, Wooyoung Go, Jongyoul Park, Jungyeul Park, KyungTae Lim
| Challenge: | Continual pre-training (CPT) has been widely adopted as a method for domain expansion in large language models, but has faced challenges such as acquiring large-scale domain-specific datasets and high computational costs. |
| Approach: | They propose a method that integrates the Test-Enhanced Learning principle with CPT to promote efficient domain-specific knowledge acquisition and long-term memory retention. |
| Outcome: | The proposed method outperforms existing methods by 23.6% in the financial domain and achieves 9.8% improvement in long-term memory retention. |
EMA: An Episodic Memory Agent for Efficient and Selective Memory (2026.findings-acl)
Copied to clipboard
| Challenge: | Existing memory-augmented methods often incorporate full dialog histories without filtering, resulting in information redundancy and inference latency. |
| Approach: | They propose a framework that abstracts conversational context into Episodic Memory Units (EMUs) they propose EMA, MemDecider and a filtering decision module to reduce noise and improve overall performance. |
| Outcome: | The proposed framework reduces token consumption by 11.48% while improving performance on two widely-used benchmarks. |